What Is Claimed Is: 



1 1 . A method for deferring execution of instructions with unresolved 

2 data dependencies as they are issued for execution in program order, comprising; 

3 issuing instructions for execution in program order during a normal 

4 execution mode; and 

5 upon encountering an unresolved data dependency during execution of an 

6 instruction, 

7 generating a checkpoint that can subsequently be used to 

8 return execution of the program to the point of the instruction, and 

9 executing subsequent instructions in an execute-ahead 

10 mode, wherein instructions that cannot be executed because of an 

1 1 unresolved data dependency are deferred, and wherein other non- 

12 deferred instructions are executed in program order. 

1 2. The method of claim 1 , wherein if the unresolved data dependency 

2 is resolved during execute-ahead mode, the method further comprises: 

3 executing deferred instructions in a deferred execution mode; and 

4 if all deferred instructions are executed, returning to the normal execution 

5 mode to resume normal program execution from the point where the execute- 

6 ahead mode left off. 

1 3. The method of claim 2, wherein executing deferred instructions in 

2 the deferred execution mode involves: 

3 issuing deferred instructions for execution in program order; 

4 deferring execution of deferred instructions that still cannot be executed 

5 because of unresolved data dependencies; and 
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6 executing other deferred instructions that able to be executed in program 

7 order. 



1 4. The method of claim 3, wherein if some deferred instruction are 

2 deferred again, the method further comprises returning to execute-ahead mode at 

3 the point where execute-ahead mode left off. 

1 5. The method of claim 2, wherein generating the checkpoint involves 

2 saving a precise architectural state of the processor to facilitate subsequent 

3 recovery from exceptions that arise during execute-ahead mode or deferred mode. 

1 6. The method of claim 1 , wherein executing instructions involves 

2 keeping track of data dependencies to facilitate determining if an instruction is 

3 subject to an unresolved data dependency. 

1 7. The method of claim 1 , wherein keeping track of data 

2 dependencies involves maintaining state information for each register, which 

3 indicates whether or not a value in the register depends on an unresolved data- 

4 dependency. 

1 8. The method of claim 1 , wherein the unresolved data dependency 

2 can include: 

3 a use of an operand that has not returned from a preceding load miss; 

4 a use of an operand that has not returned from a preceding translation 

5 lookaside buffer (TLB) miss; 

6 a use of an operand that has not returned from a preceding full or partial 

7 read-after-write (RAW) from store buffer operation; and 
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8 a use of an operand that depends on another operand that is subject to an 

9 unresolved data dependency. 

1 9. The method of claim 1 , wherein if a non-data-dependent stall 

2 condition is encountered while executing in normal mode or execute-ahead mode, 

3 the method further comprises: 

4 moving to a scout mode, wherein instructions are speculatively executed 

5 to prefetch future loads, but wherein results are not committed to the architectural 

6 state of the processor; and 

7 when the launch point stall condition (the unresolved data dependency or 

8 the non-data dependent stall condition that originally caused the system to move 

9 out of normal execution mode) is finally resolved, using the checkpoint to resume 

10 execution in normal mode from the launch point instruction (the instruction that 

1 1 originally encountered the launch point stall condition). 

1 10. The method of claim 9, wherein the non-data-dependent stall 

2 condition can include: 

3 a memory barrier operation; 

4 a load buffer full condition; and 

5 a store buffer full condition. 

1 11. The method of claim 1 , wherein deferring instructions involves 

2 storing instructions in a deferred buffer that is organized as a first-in first-out 

3 buffer. 
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1 12. The method of claim 1, wherein issuing instructions for execution 

2 in program order involves issuing instructions from an instruction buffer that is 

3 organized as a first-in first-out buffer. 

1 1 3 . An apparatus that defers execution of instructions with unresolved 

2 data dependencies as they are issued for execution in program order, comprising: 

3 an execution mechanism configured to issue instructions for execution in 

4 program order during a normal execution mode; 

5 a detection mechanism configured to detect an unresolved data 

6 dependency; 

7 wherein if an unresolved data dependency is detected during execution of 

8 an instruction, the execution mechanism is configured to, 

9 generate a checkpoint that can subsequently be used to 

10 return execution of the program to the point of the instruction, and 

11 to 

12 execute subsequent instructions in an execute-ahead mode, 

13 wherein instructions that cannot be executed because of an 

14 unresolved data dependency are deferred, and wherein other non- 
15 deferred instructions are executed in program order. 

1 14. The apparatus of claim 1 3 , 

2 wherein if the unresolved data dependency is resolved during execute- 

3 ahead mode, the execution mechanism is configured to execute deferred 

4 instructions in a deferred execution mode; and 

5 wherein if all deferred instructions are executed during deferred execution 

6 mode, the execution mechanism is configured to return to normal execution mode 
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7 to resume normal program execution from the point where the execute-ahead 

8 mode left off. 

1 15. The apparatus of claim 14, wherein while executing deferred 

2 instructions in the deferred execution mode, the execution mechanism is 

3 configured to: 

4 issue deferred instructions for execution in program order; 

5 defer execution of deferred instructions that still cannot be executed 

6 because of unresolved data dependencies; and to 

7 execute other deferred instructions that able to be executed in program 

8 order. 

1 16. The apparatus of claim 1 5, wherein if some deferred instruction are 

2 deferred again, the execution mechanism is configured to return to execute-ahead 

3 mode at the point where execute-ahead mode left off. 

1 1 7. The apparatus of claim 14, wherein while generating the 

2 checkpoint, the execution mechanism is configured to save a precise architectural 

3 state of the processor to facilitate subsequent recovery from exceptions that arise 

4 during execute-ahead mode or deferred mode. 

1 18. The apparatus of claim 1 3 , wherein the execution mechanism is 

2 configured to keep track of data dependencies to facilitate determining if an 

3 instruction is subject to an unresolved data dependency. 

1 19. The apparatus of claim 1 3 , wherein while keeping track of data 

2 dependencies, the execution mechanism is configured to maintaining state 
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information for each register, which indicates whether or not a value in the 
register depends on an unresolved data-dependency. 

20. The apparatus of claim 13, wherein the unresolved data 
dependency can include: 

a use of an operand that has not returned from a preceding load miss; 

a use of an operand that has not returned from a preceding translation 
lookaside buffer (TLB) miss; 

a use of an operand that has not returned from a preceding full or partial 
read-after- write (RAW) from store buffer operation; and 

a use of an operand that depends on another operand that is subject to an 
unresolved data dependency. 

2 1 . The apparatus of claim 1 3, 

wherein if a non-data-dependent stall condition is encountered while 
executing in normal mode or execute-ahead mode, the execution mechanism is 
configured to move into a scout mode; 

wherein during scout mode instructions are speculatively executed to 
prefetch future loads, but results are not committed to the architectural state of the 
processor; and 

wherein during scout mode when the launch point stall condition (the 
unresolved data dependency or the non-data dependent stall condition that 
originally caused the system to move out of normal execution mode) is finally 
resolved, the checkpoint is used to resume execution in normal mode from the 
launch point instruction (the instruction that originally encountered the launch 
point stall condition). 
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1 22. The apparatus of claim 2 1 , wherein the non-data-dependent stall 

2 condition can include: 

3 a memory barrier operation; 

4 a load buffer full condition; and 

5 a store buffer full condition. 

1 23. The apparatus of claim 13, further comprising a deferred buffer for 

2 storing deferred instructions, wherein the deferred buffer is organized as a first-in 

3 first-out buffer. 

1 24. The apparatus of claim 13, further comprising an instruction buffer 

2 for storing instructions to be issued for execution in program order, wherein the 

3 instruction buffer is organized as a first-in first-out buffer. 

1 25 . A microprocessor that defers execution of instructions with 

2 unresolved data dependencies as they are issued for execution in program order, 

3 comprising: 

4 a microprocessor chip containing one or more microprocessor cores; 

5 an execution mechanism within a microprocessor core configured to issue 

6 instructions for execution in program order during a normal execution mode; 

7 a detection mechanism within the microprocessor core configured to 

8 detect an unresolved data dependency during execution of an instruction; 

9 wherein if an unresolved data dependency is detected during execution of 

10 an instruction, the execution mechanism is configured to, 

1 1 generate a checkpoint that can subsequently be used to 

1 2 return execution of the program to the point of the instruction, and 

13 to 
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14 execute subsequent instructions in an execute-ahead mode, 

1 5 wherein instructions that cannot be executed because of an 

1 6 unresolved data dependency are deferred, and wherein other non- 

17 deferred instructions are executed in program order. 
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